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(57) Abstract 

Methods and apparatus for incorporating par- 
tial knowledge of system measurement noise into an 
adaptive filtering algorithm, for example in the con- 
text of an echo cancelation system. Adaptive algo- 
rithms according to the invention are obtained by 
minimizing a best linear unbiased estimate (BLUE) 
criterion function using a stochastic gradient method 
and by then converting to the frequency domain to 
reduce computational complexity. Advantageously, 
system noise characteristics are measured during nat- 
ural pauses in user speech and then taken into ac- 
count during filter adaptation. As a result, echo can- 
celers constructed according to the invention can pro- 
vide good echo cancelation even in situations where 
there is considerable background noise. According 
to an exemplary embodiment, an echo cancelation 
device configured to suppress an echo component of 
an observed signal, wherein the echo component re- 
sults from coupling of an echo source signal through 
an echo path. The echo cancelation device includes 
an adaptive filter configured to approximate the echo 
path and to thereby provide an estimate of the echo 
component, wherein an adaptive algorithm of the 
adaptive filter incorporates a measurement of a noise 
component of the observed signal. 
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METHODS AND APPARATUS FOR 
CONTROLLING FILTER ADAPTION IN NOISE 

BACKGROUND OF THE INVENTION 

The present invention relates to communications systems, and more particularly, 
5 to echo suppression in bi-directional communications links. 

Signal echo is a well known phenomenon by which energy in a transmitted signal 
reflects back toward the source of the signal. For example, in the context of network 
telephony, signal echo can result from reflections at the hybrid circuits which link four- 
wire network connections to two-wire local connections (e.g., at a subscriber loop). 
10 Considerable echo is also generated when a telephone set is used in the so-called hands- 
free mode (e.g., in teleconferencing systems and automobile telephone applications). In 
the hands-free context, echo results from acoustical coupling between a telephone 
loudspeaker and a proximate telephone microphone. 

Such signal echo is not typically a concern where the round trip delay associated 
15 with the echo is small. However, where the round trip delay is longer (e.g., on the order 
of hundreds of milliseconds), the signal echo can become annoying or even intolerable 
for a human telephone user. In practice, the round trip delay can be a physical delay 
caused by a long transmission path (e.g., when a satellite link is used) or a processing 
delay caused by network equipment (e.g., a digital speech encoder or decoder). 
20 The echo problem can be understood with reference to Figure 1 , wherein a bi- 

directional communication link between a far-end user and a near-end user is depicted in 
combination with an exemplary echo suppression system 100 in which the teachings of 
the present invention can be implemented. As shown, the exemplary echo suppression 
system 100 includes an echo canceler 110 comprising an adaptive filter 105, a double-talk 
25 detector 1 15, a summation device 125 and a non-linear processor 135. 

In Figure 1, a far-end input signal x(t) (e.g., an audio signal in the context of 
network telephony) is coupled to a reference input of the adaptive filter 105 and to a first 
reference input of the double-talk detector 1 15. Additionally, an echo estimate output 
s(t) of the adaptive filter 105 is coupled to a subtractive input of the summation device 
30 125, and an observed near-end signal j<0 is coupled to an additive input of the 

1 
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detection output of the double-talk detector 1 15 is coupled to a control input of the 
adaptive filter 105, and an error signal output e{t) of the summation device 125 is 
coupled to an input of the non-linear processor 135. An output of the non-linear 
processor 135 serves as a far-end signal output for the echo canceler 1 10. 
5 In operation, the far-end signal x{t) is provided to the near-end user and is at the 

same time modified and reflected back toward the far-end user by the near-end echo 
path H. As described above, the near-end echo path H results, for example, from a hybrid 
mismatch in a telephone network and/or an unblocked acoustic path between a near-end 
loudspeaker and a near-end microphone. The near-end echo path H can be characterized 
10 by its impulse response h and is represented conceptually as an finite impulse response 
(FIR) filter 150 in Figure 1. 

As shown, the resulting echo signal s(t) then combines with a near-end input 
signal v(f) to yield the observed near-end signal y(t) at the input of the echo canceler 1 10. 
The near-end signal v(r) includes, for example, near-end voice and/or near-end 
1 5 background noise. Mixing of the near-end signal v(t) and the echo signal s(t) is 

represented in the system 100 of Figure 1 by way of a second summing device 155. 
Those skilled in the art will appreciate, however, that the second summing device 155 is 
conceptual in nature and that no such device is actually included in a practical system. 
Rather, mixing of the near-end signal v(r) and the echo signal s(t) is inherent in the 
20 system configuration (e.g., when a near-end microphone simultaneously picks up near- 
end voice and noise as well as echo from a near-end loudspeaker). 

To prevent the echo signal s(t) from reaching the far-end user, the echo canceler 
110 dynamically adjusts the impulse response of the adaptive filter 105 to match that of 
the near-end echo path H and subtracts the resulting echo estimate s (f) from the observed 
25 near-end signal y(t) to provide the echo-canceled error, or residual signal e(t). However, 
since the adaptive filter 105 typically cannot provide a perfect match (e.g., due to non- 
linearities in the network equipment and/or dynamic changes in the near-end echo path), 
the echo canceler also uses the non-linear processor, or residual echo suppressor 135 to 
provide additional echo suppression as necessary. Additionally, because the signals 
30 involved in a telephone call are nonstationary by nature, the echo canceler 1 1 0 also 
typically uses the double-talk detector 1 1 5 to inhibit filter adaptation when a 
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measurement of the echo signal to near end signal ratio indicates that improvement of the 
echo path estimate cannot be attained by continuing to adapt the filter 105. 

According to most conventional systems, the echo canceler 1 10 employs a least 
mean squares (LMS) adaptive algorithm or a normalized least mean squares (NLMS) 

5 adaptive algorithm to update the filter 105. Such algorithms are attractive for use in 
practical systems as they are quite robust and provide low computational complexity. 
Other conventional systems have employed the well known affine projection adaptive 
algorithm (see, for example, U.S. Patent No. 5,428,562 to Gay, issued June 27, 1995) and 
various frequency domain algorithms (see, for example, J.J. Shynk, 'Trequency-Domain 

1 0 and Multirate Adaptive Filtering," IEEE Signal Processing Magazine, Jan. 1 992, 

pp. 14-37 and J. Soo and K.K. Pang, "Multidelay Block Frequency Domain Adaptive 
Filter," IEEE Trans. Acoustics, Speech and Signal Processing, vol. 38, No. 2, Feb. 1990, 
pp. 373-376). 

Most of the above described conventional adaptive algorithms are designed to 
1 5 minimize in some sense the error signal power E[«*(/)], or some estimate thereof, and 
therefor implicitly assume that the noise component of the near-end input signal v(0 is 
either absent or white. While such an assumption is accurate where the noise component 
consists primarily of thermal noise or quantization noise, it is often faulty in practical 
situations where the noise component instead consists primarily of background sounds 
20 from the near-end environment. 

Consequently, conventional echo canceling systems often perform poorly in the 
presence of substantial colored near-end noise, and thus there is a need for improved 
methods and apparatus for adapting echo cancelation filters. 

gTTTVTMAKV OF THE IN VENTION 

25 The present invention fulfills the above-described and other needs by providing 

methods and apparatus for incorporating partial knowledge of system measurement noise 
into an adaptive filtering algorithm. Exemplary algorithms are obtained by minimizing a 
best linear unbiased estimate (BLUE) criterion function using a stochastic gradient 
method and by then converting to the frequency domain to reduce computational 

30 complexity. Advantageously, system noise characteristics are measured during natural 
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pauses in user speech and then taken into account during filter adaptation. Thus, as 
compared to conventional devices, an echo canceler constructed according to the 
invention provides superior echo cancelation in situations where there is considerable 
background noise. 

5 According to an exemplary embodiment, an echo cancelation device is configured 

to suppress an echo component of an observed signal, wherein the echo component 
results from coupling of an echo source signal through an echo path. According to the 
embodiment, the echo cancelation device includes an adaptive filter configured to 
approximate the echo path and to thereby provide an estimate of the echo component, 
10 wherein an adaptive algorithm of the adaptive filter incorporates a measurement of a 

noise component of the observed signal. Advantageously, the measurement of the noise 
component of the observed signal can be an a priori measurement made in an 
environment in which the echo cancelation device is designed to operate. Alternatively, 
measurements of the noise component of the observed signal can be made in real time 
1 5 during the natural pauses in one or more speech components of the observed signal. In an 
exemplary embodiment, such pauses are detennined based upon a measurement of power 
in a block of samples of the echo source signal. 

According to additional embodiments, the echo estimate is subtracted from the 
observed signal to provide an echo-canceled error signal, and an estimated impulse 
20 response of the adaptive filter is computed based upon an estimate of a power spectrum of 
the error signal and an estimate of a power spectrum of the echo source signal. 
Advantageously, the estimated impulse response of the adaptive filter can be selectively 
updated. For example, the estimated impulse response can be updated when a 
measurement of power in a block of samples of the echo source signal is above a 
25 threshold, and not updated otherwise. According to embodiments, the estimated impulse 
response of the adaptive filter is computed based upon a weighted sum of the error signal 
power spectrum estimate and the echo source power spectrum estimate. For example, the 
weighted sum can be computed by adding the echo source power spectrum estimate to a 
product of the error signal power spectrum estimate and a noise matching parameter. 
30 Advantageously, the noise matching parameter can be adjusted dynamically based upon 
samples of the error signal and samples of the echo source signal. 
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An exemplary method for canceling an echo component of an observed signal 
according to the invention includes the steps of sampling an echo source signal to provide 
a block of source signal samples, computing a discrete Fourier transform of the block of 
source signal samples to provide a frequency domain representation of the source signal, 
5 multiplying the frequency domain representation of the source signal by a frequency 
domain estimate of an impulse response of the echo path to provide a frequency domain 
echo estimate, computing an inverse discrete Fourier transform of the frequency domain 
echo estimate to provide a time domain echo estimate, subtracting the time domain echo 
estimate from the observed signal to provide an echo canceled error signal, computing a 
1 0 discrete Fourier transform of a block of samples of the error signal to provide a frequency 
domain representation of the error signal, and adapting the frequency domain estimate of 
the impulse response of the echo path based upon the frequency domain representation of 
the error signal and based upon the frequency domain representation of the source signal. 
Advantageously, the step of adapting the frequency domain estimate of the impulse 
1 5 response incorporates a measurement of a noise component of the observed signal. 

According to exemplary embodiments, the step of adapting the frequency domain . 
estimate of the impulse response includes the steps of updating the frequency domain 
estimate of the impulse response when a measurement of power in the block of source 
signal samples is above a threshold, and updating an estimate of a noise power spectrum 
20 of the error signal otherwise. Additionally, the step of updating the frequency domain 
estimate of the impulse response can include the steps of updating an estimate of a signal 
power spectrum of the source signal, computing a weighted sum of the noise power 
spectrum estimate and the signal power spectrum estimate, and computing an update of 
the frequency domain estimate based upon the weighted sum. Advantageously, the 
25 weighted sum can be computed by adding the signal power spectrum estimate to a 
product of the noise power spectrum estimate and a noise matching parameter. 
According to embodiments, the noise matching parameter is dynamically adjusted based 
upon samples of the echo source signal and the echo canceled error signal. 

These and other features and advantages of the present invention are explained in 
30 greater detail hereinafter with reference to the illustrative examples shown in the 
accompanying drawings. Those skilled in the art will appreciate that the described 
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embodiments are provided for purposes of illustration and understanding and that 
numerous equivalent embodiments are contemplated herein. 

BRIEF DESCR IPTION OF THE DRAWINGS 

Figure 1 depicts an exemplary echo cancelation system in which embodiments of 
5 the invention can be implemented. 

Figure 2 depicts an exemplary adaptive algorithm according to the invention. 
Figures 3-5 depict computer simulation results demonstrating the efficacy of 
embodiments of the invention. 

Figures 6 and 7 depict an alternative adaptive algorithm according to the 
10 invention. 



DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS 

According to the invention, a best linear unbiased estimate (BLUE) criterion 
function is used as a target function in the development of adaptive filter algorithms for 
use in echo cancelation systems. Advantageously, such a target function enables the 

1 5 resulting algorithms to account for color which can be present in the measurement noise 
of practical echo cancelation systems. Consequently, the resulting algorithms provide 
improved echo cancelation performance as compared to conventional algorithms. 

In the following rigorous development of the adaptive algorithms of the present 
invention, italic letters, boldface lowercase letters and boldface uppercase letters are used 

20 to represent scalars, column vectors and matrices, respectively. Additionally, superscripts 
T, H and f are used to denote transpose, Hermitian transpose and Moore-Penrose pseudo- 
inverse operations, respectively. Further, the symbol I is used to represent the identity 
matrix, and the symbol 0 is used to represent a matrix of all zeros. 

Assuming that the echo path H in an echo canceling system can be modeled as a 

25 finite impulse response filter having N taps or filter coefficients, and also assuming that 
the correlation properties of the near-end input signal x(t) of the system can be well 
modeled using L correlation lags, then an alternative best linear unbiased estimate 
criterion function Kcan be defined as: 



6 
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F= (Xh - y) r (yRv + XX^CXh - y), 



(1) 





10 



15 



20 



25 



where h is the N vector of unknown filter coefficients (i.e., the impulse response of the 
echo path H), y is a positive constant and X is an M * AT matrix of input signal samples 
defined as X = [x(*)...x(/ - 1)], with x(0 = [x^... , x t ] T . Additionally, the vector 
y = Xh + v is the M vector of observed signal samples, and v is the M vector of 
measurement noise samples having symmetric Toeplitz covariance matrix . Note that, 
although the above provided definition of the input sample matrix X is perhaps not the 
most consequent definition in certain contexts, it beneficially provides frequency domain 
algorithms which show strong similarities with the classical overlap-save frequency 
domain adaptive filter (FD AF) algorithms which are described, for example, in G. A. 
Clark, S.R. Parker and S.K. Mitra, "A Unified Approach to Time- and Frequency-Domain 
Realization of FIR Adaptive Digital Filters," IEEE Trans. Acoustics, Speech and Signal 
Processing, Vol. 31, pp. 1073-1083, Oct. 1983; S. Haykin, "Adaptive Filter Theory;' 
Third Edition, Prentice Hall, 1996; and the above cited article by JJ. Shynk, "Frequency- 
Domain and Multirate Adaptive Filtering," IEEE Signal Processing Magazine, Jan. 1992, 
pp. 14-37). 

Given the criterion function definition of equation (1), the derivative of the 
criterion function V with respect to the unknown coefficient vector h can be written as 



?L = 2[X r (YRv + XX^Xh - 2X r (vRv + XXO f y 
dh 

= -2X r (vR v + XX 7 ) t e, 



(2) 



where e = y - Xh, corresponding to samples of the error signal e(t) described above. An 
estimate of the coefficient vector h can thus be written as 

= (X r ( Y Rv + xxWx'CyRv + xxO f y. (3) 

Advantageously, it can be shown that equation (3) is the best linear unbiased 
estimate of the coefficient vector h for the case of possibly singular 1^ . Further, it is 
argued in T. Soderstrom and P. Stoica, "System Identification;* Prentice Hall, 1988, 
pp. 89-90, that this estimate, at least for the case y = 1, has better numerical properties 
than the more traditional best linear unbiased estimate resulting from minimization of 
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(Xh - y^ 'CXh - y) (see, for example, K.C. Ho, "A Minimum Misadjustment 
Adaptive FIR Filter," IEEE Trans. Signal Processing, Vol. 44, pp. 577-585, 
March, 1996). 

According to the invention, a gradient algorithm for estimating the coefficient 
vector h can then be defined such that equation (1) is minimized. Specifically, a gradient 
algorithm according to the invention is defined as 

e(0=y«-X(0fc(0 ( 4 ) 

h(/+l) = n(/) + //X r (0(YRv+X(/)XWe(0- ( 5 ) 

Note that in the equations above, the length M of the entire signal has been 
replaced by a block length L< M in all corresponding matrix dimensions. Note also that, 
in the case of white noise v(t), the gradient algorithm of the invention coincides with the 
relaxed and regularized form of the affine projection algorithm with the regularization 
parameter proportional to the measurement noise variance (see, for example, S.L. Gay 
and S. Tavathia, "The Fast Affine Projection Algorithm," Proc. ICASSP'95, Detroit, Vol. 
5, pp. 3023-3026, May, 1995). 

According to the invention, however, the equations above are used to develop a 
frequency domain algorithm. To do so, an (N + L) x (N + L) cyclically extended input 
signal matrix is defined as 

X c (0 = cyc\([x,_ N . L+1 x,x t . x ... x,. N . L+2 ]) 

X t-N-L + \ X t "' X t-N-L*2 
X t-N-L*2 X t-N-L*\ "' X l-N-L*3 

X l-L X t-L*l " X t-L-\ 
X l-L*\ X t-L "' X t-L-2 

X l X i-l "' X l-N-L*l 

Note that this is just one particular cyclic extension of several possible. The 
advantage of this cyclic extension is that it leads to intuitively well understandable 
algorithms. A similar extension is used, for example, in the above cited paper by G. A. 

8 
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Clark, S.R. Parker and S.K. Mitra, "A Unified Approach to Time- and Frequency-Domain 
Realization of FIR Adaptive Digital Filters," IEEE Trans. Acoustics, Speech and Signal 
Processing, Vol. 31, pp. 1073-1083, Oct. 1983. 

The original input signal matrix X(/) appears in the lower left corner of the 
cyclically extended input signal matrix X c (f) and, consequently, the input signal matrix 
X(t) can be written as 



X(t) = [0 LxN l L )X c (t) 



(6) 



The extended matrix X c (0 is right-cyclic by construction and so is its transpose 
X T c (0 . The eigendecomposition of a right-cyclic matrix (see, for example, S.L. Marple, 
10 Jr., "Digital Spectral Analysis with Applications," Prentice Hall, 1987) is given by 



X = FAF * 

c 



(7) 



where the symbol F represents the (N+L)*(N+ L) discrete Fourier transform matrix 



having elements f w 



1 . exp \ ^"" j , and where the symbol A represents a diagonal 



matrix formed by the discrete Fourier transform of the first row of the extended transpose 



1 5 matrix X . Specifically, the diagonal matrix A is defined as 



A = diag(DFT([* ( .„_ i+1 ..JC,])). 



In the case of real valued signals, the transpose of X c and the Hermitian transpose 
ofX, are the same and, hence, X^ = FAF H = F H A w F and X c = FA W F w = ¥ H AF. 

Thus, substituting equations (6) and (7) into equations (4) and (5), the adaptive 
20 algorithm of the invention can be expressed as: 



e<f) = -Pi.* Id*" AF 



h(0 



(8) 
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n(/+l) = &(0 + M[IAxJF W A w F 



(9) 



I. 



(YRv + XXW)- 



Further, by defining a frequency response vector for the unknown system as 



f(0 = F 



h(0, 



(10) 



5 and by defining an intermediate vector g(r) as 

0. 



g(0 = F 



I. 



( Y R, + X(/)XWe(0, 



(11) 



the adaptive algorithm of the invention can be expressed as 



e(0 = y(0-[0 ix „ IJF" Af(r) 



(12) 



f (r+l) = f(0 + nF 



L*N 



(13) 



1 0 According to a first exemplary embodiment, the term yR* + X(t)X T (t) is 

approximated by a Toeplitz matrix, and a recursive algorithm such as the well known 
Levinson algorithm (see, for example, the above cited text by S.L. Marple, Jr., "Digital 
Spectral Analysis with Applications, 11 Prentice Hall, 1987) is used to find the term 
(yRv + X(0X r (/)) f e(0. This first embodiment is referred to hereinafter as ALGOL 

15 For the case of I « N, the first embodiment ALGOl provides satisfactory 

computational complexity on the order of (0((N + L) log 2 (N + L)) + 0(L 2 )). However, 
since the complexity of the Levinson algorithm is not acceptable in all practical 
situations, the present invention utilizes several simplifying approximations to provide an 
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alternative, more streamlined algorithm. Advantageously, the above described first 
embodiment ALGOl has been used in computer simulations to validate the 
approximations used to derive the lower complexity algorithm. Results of the computer 
simulations are described in detail below with reference to Figures 3-5. 

To derive the lower complexity algorithm, the intermediate vector g(t) is 
expressed alternatively as 



g(0 = 



/ 












F 









CyR +X(f)X (0) 



(14) 



x [0, 



e(0 



To see that this is possible, consider the equation Rz = e, where R = yRv + XX r is 
10 a nonnegative definite L*L matrix and z and e are L vectors. The latter portion of the 
equation is equivalent to 























V R 




z 




e 



which can be rewritten as 



















= F 




V R 




z 




e 



Thus, by equation (1 1), the vector g(0 can be expressed as 

0.. 



B(0 = F 



z 



or 
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g(0 = 





t 






t 






F 




f" 


F 








V R 


j 




e 



which is equivalent to the expression for g(f) provided in equation (14). 

According to the invention, the input signal correlation matrix is then 
approximated by a Toeplitz Matrix R x » X(t)X T (t), and a cyclic extension R,, of the sum 
of the correlation matrices is defined to satisfy 



I, 



Then, assuming that L<N+ 1, the first row of the extension R^. obeys even DFT 
symmetry and, as a result, it can be decomposed as 

R c = DF = FDF", (15) 



where D is a diagonal matrix with the discrete Fourier transformed first row of R c on the 
10 main diagonal. The main diagonal of D is thus real and symmetric by construction. 
Accordingly, equation (14) can now be rewritten as 



g(0 = (KDK) *F 



e(0 



(16) 



where 



K = F 



t<WJ F 



can be seen as a window matrix. More specifically, the matrix K is a right-cyclic matrix 
1 5 with elements of the first row given by 



K(1, M )=— exp 



-;G>(2tf+I-l) 



sin(0)I/2) 



sin(0)/2) 



go = 271/1 which corresponds to a rectangular window in the time domain. 
N+L 
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Note that using equation (16) in equation (13) still results in an algorithm with 
relatively high computational complexity. Advantageously, however, the present 
invention provides a very low complexity algorithm by approximating the matrix K by an 
identity matrix. Interestingly, such an approximation results in an algorithm which is 
5 very similar to the self-orthogonalizing frequency domain adaptive filter (see, for 
example, the above cited article by J J. Shynk, "Frequency-Domain and Multirate 
Adaptive Filtering," IEEE Signal Processing Magazine, Jan. 1 992, pp. 1 4-37) with signal 
power at frequency bins (used to normalize the step sizes at respective frequencies) 
replaced by the weighted sum of signal and measurement noise powers. 
10 In the foregoing discussion, it has been assumed that the measurement noise 

correlation matrix is known. In practice, however, is often unknown and is 
estimated. For example, in voice echo cancelation applications, it is natural to initialize 
the estimate as a\l, where a\ is an expected noise power. Further, in certain 
applications, it is possible to obtain a better initial estimate during the algorithm 
15 initialization phase. The estimate can then be refreshed during natural pauses in speech 
(e.g., when Tr(AA") is above a predefined threshold th). Advantageously, doing so does 
not have a significant impact on the computational complexity of the algorithm, as the 
coefficients should not be updated when the input signal power is low anyway (see, for 
example, T. Petillon, A. Gilloire and S. Theodoridis, "The Fast Newton Transversal 
20 Filter: An Efficient Scheme for Acoustic Echo Cancellation in Mobile Radio," IEEE 
Trans. Signal Processing, Vol. 42, pp. 509-517, March 1994). 

The resulting low-complexity algorithm according to the invention, referred to 
hereinafter as ALG02, is thus described arithmetically as follows: 
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ADAPTIVE AL GORITHM ALGQ2 
INITIALIZE ESTIMATES AS: 

P,(r=0) = a\^ L 



10 



THEN, FOR EACH NEW BLOCK 
OF L INPUT SAMPLES, COMPUTE: 
A = diag(DFT([x,.„. i+1 ••*,])) 
e(0 = y(0-[<WJF" Af(0 

c(0 - f[°- 

AND, IF Tr(AA") > th, THEN COMPUTE: 
J> x = pT> x + (\-p)h\ H 
D = P x + yP u 

g (0 = DM*) 



f(r+i) = ?(0 + n* 



ELSE, COMPUTE: 
P B =^P y +(l-/?)diag(c)diag(c) w 



1 5 Note that the equations of the low-complexity algorithm ALG02 can be applied 

every sample or once per block of samples. Applying the equations once every block of 
L samples reduces computational complexity at the price of creating an Z.-sample delay 
and providing a somewhat slower initial convergence. Note also that the matrix D can be 



14 



WO 99/41848 PCT/SE99/00135 



updated directly in the frequency domain instead of first updating the matrix and 

computing the DFT. 

A flow diagram corresponding to the above described low-complexity algorithm 
ALG02 is depicted in Figure 2. As shown, the input signal x(t) is coupled to an input of 
5 a first sampling block 205, and an output of the first sampling block is coupled to an 
input of a first FFT block 210. An output z(t) of the first FFT block 210 is coupled to a 
first input of a first multiplier 215, and an output of the first multiplier 215 is coupled to 
an input of a first IFFT block 220. An output of the first EFFT block 220 is coupled to an 
input of a second sampling block 225, and an output of the second sampling block 225 is 
10 coupled to a subtractive input of a first summing device 230. The observed near-end 
input signal y(t) is coupled to an additive input of the first summing device 230, and an 
output of the first summing device 230 serves as the residual or error signal e(t). 

The error signal e(i) is coupled to an input of a first zero-padding block 235, and 
an output of the first zero-padding block 235 is coupled to an input of a second FFT block 
1 5 240. An output c(t) of the second FFT block 240 is coupled to an input of a noise power 
spectrum update block 245 and to a first input of a second multiplier 255. The second 
multiplier 255 receives an additional input from a conjugation block 250, and the 
conjugation block 250 in turn receives the output z(t) of the first FFT block 210 as input. 
The output z(r) of the first FFT block 210 and an output of the conjugation block 250 are 
20 also coupled to first and second inputs, respectively, of a signal power spectrum update 
block 260. An output of the signal power spectrum update block 260 and an output of the 
second multiplier 255 are then coupled to first and second inputs, respectively, of a 
normalization block 265. Additionally, an output of the noise power spectrum update 
block 245 is coupled to a third input of the normalization block 265. 
25 An output g(/) of the normalization block 265 is coupled to an input of a second 

IFFT block 270, and an output of the second IFFT block 270 is coupled to an input of a 
second zero-padding block 275. An output of the second zero-padding block 275 is 
coupled to an input of a third FFT block 280, and an output of the third FFT block 280 is 
coupled to a first additive input of a second summing device 285. An output fy+l) of the 
30 second summing device 285 is coupled to an input of a one-sample delay block 290, and 
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an output ?(/) of the one-sample delay block 290 is coupled to a second input of the first 
multiplier 215 and to a second additive input of the second summing device 285. 

In operation, the first sampling block 205 forms a block of L new and N old 
samples of the input signal jc(*)- The first FFT block 210 then computes the discrete 
5 Fourier transform of the resulting input sample block (preferably using a Fast Fourier 
Transform algorithm) to provide the frequency domain sample vector z(/). The first 
multiplier 215 then element-wise multiplies the vector z(t) by the delay block output i(t) 
(which represents the frequency-domain estimate of the impulse response h) to form an 
echo estimate in the frequency domain. Thereafter, the first IFFT block 220 computes the 

10 inverse discrete Fourier transform of the resulting frequency-domain echo estimate, and 
the second sampling block 225 extracts the last L samples to provide the time-domain 
echo estimate (i.e., s(t)). The first summation device 230 then subtracts the resulting 
time-domain echo estimate from the observed near-end signal y{i) to form a sample block 
of the residual signal e(/) as desired. 

15 As shown, the residual signal e(0 is used in combination with the frequency- 

domain sample vector z(t) to compute the frequency-domain impulse response estimate 
?(f). Specifically, the first zero-padding block 235 complements the residual signal 
sample block with N leading zeros, and the second FFT block computes the discrete 
Fourier transform of the resulting zero-padded sample block to form the frequency 

20 domain representation of the residual signal (i.e., c(/)). Thereafter, a determination is 
made as to whether the input signal power level is large enough to generate a significant 
amount of echo. Specifically, the short-term power estimate (i.e., based on the current 
block of samples of the frequency domain input signal z(f)) is compared to the 
predetermined threshold th as described above. If the input signal power is above the 

25 threshold th 9 the algorithm proceeds to update the frequency-domain impulse response 
estimate as indicated by a lightly shaded box 202 in Figure 2. Otherwise, the algorithm 
updates the noise power spectrum estimate as indicated by a darkly shaded box 201 in 
Figure 2. Of course, the adaptation can also be qualified using the output of a double talk 
detector as described above with reference to Figure 1 . 

30 When the impulse response estimate is to be updated, the signal power spectrum 

update block 260 first computes a new estimate of the input signal power spectrum p x 
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25 



(corresponding to the elements on the main diagonal of the signal power matrix P, 
described above). In exemplary embodiments, the signal spectrum estimate is computed 
by element-wise multiplying the frequency domain input vector z(t) with its complex 
conjugate (i.e., the output of the conjugation block 250) and then averaging using, for 
example, an exponential window. The second multiplier 255 then element-wise 
multiplies the frequency-domain residual signal c(0 by the complex conjugate of the 
vector z(0, and the normalization block 265 normalizes (i.e., element-wise divides) the 
result using a weighted sum of the input and noise power spectra (i.e., p, + y Pv ) to form 
the intermediate vector g(0- Selection of the weighting parameter y, referred to 
hereinafter as the noise matching parameter, is described in detail below. 

Once the intermediate vector g(/) is determined, the second IFFT block 270 
computes the inverse discrete Fourier transform of the vector g(0, and the second zero- 
padding block 275 sets the last L elements of the resulting vector to zero. Thereafter, the 
third FFT block 280 computes the discrete Fourier transform of the output of the second 
zero-padding block 275, and the resulting vector is multiplied by the step size, or update 
gain m and added (atthe second summing device 285) to the previous frequency-domain 
impulse response estimate ?(/+l) to provide an updated frequency-domain impulse 
response estimate i(t) as desired. 

When the impulse response estimate is not to be updated (i.e., when the input 
signal power is not above the threshold th, indicating that there is a pause in user speech), 
the estimate of noise power spectrum p v (corresponding to the elements on the main 
diagonal of the noise power matrix P v described above) is updated based on the frequency 
domain representation of the residual signal c(t). In exemplary embodiments, the noise 
spectrum estimate p v is computed by element-wise multiplying the frequency domain 
representation of the residual signal c(t) with its complex conjugate and then averaging 
using, for example, an exponential window. By periodically updating the noise power 
estimate in this way, any color present in the noise signal will be accounted for when the 
impulse response estimate is adapted. 

Thus, the flow diagram of Figure 2 depicts a practical implementation of the low- 
complexity algorithm ALG02 of the invention. Those skilled in the art will appreciate 
that there is a direct correspondence between the blocks of Figure 2 and the elements of 
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the equations used above to define the exemplary algorithm ALG02. Those skilled in the 
art will also appreciate that the operational blocks of Figure 2 can be implemented in 
practice using, for example, standard digital signal processing devices, application 
specific integrated circuitry, or a general purpose digital computer. 
5 Computer simulations were performed in order to compare the performance of the 

low complexity algorithm ALG02 with that of the first, reference algorithm ALGOl and 
with that of the frequency domain adaptive filter described in the above cited article by 
J.J. Shynk, "Frequency-Domain and Multirate Adaptive Filtering," IEEE Signal 
Processing Magazine, Jan. 1992, pp. 14-37. The computer simulations also tested the 

10 relative performance of all three algorithms with respect to actual speech signals. * 
First, stationary signals were used to directly evaluate the validity of the 
approximations made when deriving the streamlined algorithm ALG02 from the 
reference algorithm ALGOl. Stationary signals were also used to directly compare the 
performance of the exemplary algorithms ALGOl, ALG02 with the performance of the 

1 5 above cited frequency domain adaptive filter. For purposes of these simulations, 

stationary signals are those for which the signal statistics do not depend on time for t > 0. 

A typical simulation result is shown in Figure 3, wherein a first plot 310 shows 
the learning curves (i.e. E[(e(i) - v (t)) 2 ]) for all three algorithms, and a second plot 320 

shows the corresponding weight errors £ ^ h "M01l j The curves represent ensemble 

IN 2 

20 averages taken over 200 independent trials. For the simulations shown in Figure 3, the 
input signal x(t) is an autoregressive process generated by 

l 

I+0.7z" l -0.1z" 2 +0.l2" 3 +0.01r" 4 * 

and the measurement noise is also an autoregressive process generated by 

l 

l-0.93z -I +0 ; 01z" 2 

25 Additionally, the SNR is approximately OdB, and the true impulse response is a 64-tap 
FIR filter with flat frequency response and coefficients distributed uniformly in the 
interval [- 1/128, 1/128]: The design parameters were chosen as follows: N = 64, L = 64, 
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= 0.04, fi- 0.99, and y = 128. Since the simulated signals are stationary, the 
measurement noise spectrum is estimated first (this time is not shown in Figure 3) and 
then used in the adaptive algorithm. 

In Figure 3, note that the curves corresponding to the first algorithm ALGOl (i.e., 
5 curves 312, 322) are not distinguishable from those corresponding to the low-complexity 
algorithm ALG02 (i.e., curves 313, 323). Advantageously, this indicates that the 
approximations made in developing the low-complexity algorithm ALG02 are at least 
reasonably good. Further, note in Figure 3 that both of the exemplary algorithms 
ALGOl, ALG02 outperform the frequency domain adaptive filter (curves 31 1, 321). 

10 Additional computer simulations were conducted to study the performance of the . 

streamlined algorithm ALG02 in an acoustic echo cancelation application (specifically in 
an automobile hands-free telephone application). Figure 4 presents the learning curves 
(averaged in time using an exponential window) of one typical simulation. For these 
simulations, the design parameters were N= 256 (corresponding to a 256-tap echo 

15 impulse response identified in a Volvo 940 with two people sitting in the front seats), 

L = 256, = 0.04, /?= 0.99, and y = 128. The noise power spectra P v was estimated on- _ 
line. For the observed input signal y{t\ a female speaker is generating the echo, and the 
echo is then corrupted by a noise recorded in a moving automobile. The sampling rate is 
8000 Hz, and the curves in Figure 4 thus correspond to a one minute time interval. 

20 As shown in the first plot 410 of Figure 4, the echo power is lower than the noise 

power most of the time. However, as the signals are concentrated in different frequency 
bands, the echo is clearly audible before adaptive processing. Though the frequency 
domain adaptive filter does improve the situation, the echo remains audible even after 
processing as shown in the second plot 420 of Figure 4. By way of contrast, the low- 

25 complexity algorithm of the invention ALG02 makes the residual echo barely audible in 
the noise (after an initial convergence period), as shown in the third plot 430 of Figure 4. 

Figure 5 shows the power spectra computed using samples 394000 to 410000 
from the curves of Figure 4. It can be seen from the first plot 510 that the echo signal 
power is above the measurement noise power at most frequencies. As shown in the 

30 second plot 520, processing by the frequency domain adaptive filter attenuates echo, but 
the residual echo power remains above the measurement noise power at several 

19 

BNSOOCIO: <WO 9941848A1 I > 



PCT/SE99/00135 

frequencies. By way of contrast, the third plot 530 shows that processing by the low 
complexity algorithm ALG02 reduces the residual echo power below the measurement 
noise power at all frequencies, and thus the masking effects of human perception make 
the echo inaudible. 

5 Note that the exemplary low-complexity algorithm ALG02 introduces an L- 

sample delay into the signal processing path. Since it is usually desirable to choose L 
approximately equal to the impulse response length N in order to reduce computational 
complexity, such a delay may be unacceptable for long echo path impulse responses. 
Advantageously, however, additional embodiments of the invention reduce the 

10 signal processing delay without dramatically increasing computational complexity. 

Specifically, the alternative embodiments divide the echo path impulse response h into 
sections of length K and treat the adaptive filter as a series connection of the resulting 
sectional filters. An analogous approach is described, for example, in the above cited 
paper by J. Soo and K.K. Pang, "Multidelay Block Frequency Domain Adaptive Filter," 

15 IEEE Trans. Acoustics, Speech and Signal Processing, vol. 38, No. 2, Feb. 1990, 
pp. 373-376). 

According to the additional embodiments, it is advantageous to set the section 
length K approximately equal to the block length L. As K«N, the delay is reduced. In 
many applications the echo canceler is followed by a speech coder which operates on 
20 blocks of signal samples and introduces a delay larger than its block length. The main 
^contribution to this delay comes from collecting the input signal samples. In these 
applications, it is desirable to set L equal to the speech codec block length, or to an 
integer fraction thereof. Then the echo canceler output block can be delivered to the 
speech coder, instead of a sequence of samples, and the overall delay is only slightly 
25 increased. The resulting algorithm, referred to hereinafter as ALG03, is as follows: 
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ADAPTIVE ALGORITHM ALGQ3 





INITIALIZE ESTIMATES AS: 

V' =0 > =W' V * 
P j( r=0) = 



P (7=0) = a I 

THEN, FOR EACH NEW BLOCK 
OF K INPUT SAMPLES, COMPUTE: 

A = A k ^Vk*kmax 
A w - diag(DFT([x . Jc . IM .. J r < ])) 

e(0 = y(0 " £ t [0 tx A1 F " A A<'> 

0. 



c(0 = F 



AND, IF £*Tr(A t A^) > ,/,, THEN COMPUTE: 

D = P x + Y*„ 
■ g(/) = 0*0(0 



c(0 



V r+1 > = V' )+,lF 



ELSE, COMPUTE: 
P = /?P + (1 diag (c) diag(c)" 



A flow diagram corresponding to the above described algorithm ALG03 is 
depicted in Figures 6 and 7. Those skilled in the art will appreciate that, just as the 
operational blocks of Figure 2 correspond to the elements of the equations used to define 
the low-complexity algorithm ALG02, so do the operational blocks of Figures 6 and 7 
5 correspond to the elements of the equations used to define the alternative algorithm 
ALG03. Like the operational blocks of Figure 2, those of Figures 6 and 7 can be 
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implemented in practice using, for example, standard digital signal processing devices, 
application specific integrated circuitry, or a general purpose digital computer. 

Note that each of the exemplary algorithms ALGOl, ALG02, ALG03 includes 
several design parameters which are set before the algorithm is implemented. 
5 Advantageously, the invention provides a guideline for properly setting these design 
parameters in practice. 

For example, the filter length N can be set based on the particular application at 
hand. In network echo cancelation and acoustic echo cancelation for automobile hands- 
free applications, a filter length or model order in the range of 256 to 512 taps typically 
1 0 provides quality results. On the other hand, in teleconferencing applications in which the 
impulse response of an entire conference room is modeled, a filter length on the order of 
several thousand taps typically provides better results. 

The impulse response section length K, used in the alternative algorithm ALG03, 
establishes the processing delay of the algorithm and should therefore be made relatively 
1 5 small. On the other hand, the overall computational complexity of the algorithm 
( increases as K decreases, and a proper trade-off is therefore established based on 
available computing power. In applications in which an echo canceler is followed by a 
speech coder, it is typically advantageous to set K equal to the block length of the speech 
coder, or some integer fraction thereof. Additionally, K is typically selected such that the 
20 number of filter sections (i.e., N/K) is an integer. 

The least computationally intensive implementation results from setting the block 
length L approximately equal to the filter length N in the first low-complexity 
embodiment ALG02 and approximately equal to the section length K in the alternative 
low-complexity embodiment ALG03. It is also advantageous to set N+L or K+L equal 
25 to an integer power of two in the first and second low-complexity embodiments ALG02, 
ALG03, respectively. 

The parameter fi determines the memory length of the power spectrum estimates 
and is made positive and less than one. Selection of fi in the interval [0.9, 0.995] has 
shown to provide quality results. 
30 The step size ft is made positive and small enough to guarantee stability of the 

adaptive algorithm. Making the step size too small, however, slows down the adaptation, 
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especially in combination with long impulse responses. Setting the step size in the range 
from 0.1//? to 0.5/R, where J! = fif^L for the first low-complexity embodiment 

ALG02and R = fi£*L for the alternative low-complexity embodiment ALG03, has 
, proven to work well. 

5 As noted above, the noise matching parameter y weights the normalizing power 

spectra of the input signal and the measurement noise and is made nonnegative. Making 
the noise matching parameter too large will cause the measurement noise to be weighted 
too heavily and will thus significantly slow down the convergence of the algorithm. On 
the other hand, making the noise matching parameter too small will cause the 

1 0 measurement noise to be weighted too lightly and will thus provide relatively fast 

adaptation at the price of higher residual echo power at steady state. In such case, the 
shape of the residual echo spectrum will be close to the original echo spectrum with some 
degree of attenuation (i.e., approximately the same echo attenuation will be obtained over 
the entire frequency band). By way of contrast, reasonably high values of y will lead to 

1 5 improved performance at steady state in the sense that the residual echo spectrum will be 
further attenuated near the frequencies where it is above the measurement noise spectrum 
(i.e., the masking effects of human perception tend to render the echo inaudible when the 
entire residual echo spectrum lies below the noise spectrum). The price for such an 
improvement can be a slightly slower initial convergence of the algorithm. However, 

20 according to the invention, this effect can be overcome by making the parameter y time 
dependent. 

For example, the noise matching parameter y can be computed as 



E[e\t)]-E[v\t)} 

where E[] denotes mathematical expectation. This approach provides a relatively small y 
when the residual echo is much stronger than the noise and thus provides relatively fast 
25 adaptation. However, if the residual echo power approaches the noise power, then y 
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becomes large, and the algorithm starts to color the residual echo spectrum as described 
above. In practice, the mathematical expectations are not known and are estimated. One 
example of such an estimate is a sum of squares over a block containing the frequency 
domain representation of the corresponding signal. In other words, the noise matching 
5 parameter can be computed as 



where c v is a block containing the frequency domain representation of the measurement 
noise and const is a small positive constant guaranteeing a positive y in the presence of 
estimation errors. 

In sum, the present invention provides a number of adaptive algorithms which can 

10 be used, for example, in echo canceling applications. The exemplary algorithms are 
derived by minimizing a best linear unbiased estimate criterion function and using 
eigenproperties of cyclic matrices. Among several possible cyclic extensions of signal 
matrices, a cyclic extension leading to adaptive algorithms similar to the classical 
frequency domain adaptive filter is used. Since the exemplary algorithms incorporate 

1 5 knowledge of measurement noise, they perform better in noisy environments as compared 
to conventional approaches. The superior performance of the disclosed algorithms in 
noisy environments has been demonstrated by way of computer simulation. 

Note that the exemplary algorithms of the invention differ from prior attempts to 
utilize a best linear unbiased estimate. For example, in the above cited paper by K.C. Ho, 

20 "A Minimum Misadjustment Adaptive FIR Filter," IEEE Trans. Signal Processing, Vol. 
44, pp. 577-585, March, 1996 and in A.C. Orgren, S. Dasgupta, C.E. Rohrs and N.R. 
Malik, "Noise Cancellation with Improved Residuals," IEEE Trans. Signal Processing, 
Vol. 39, pp. 2629-2639, Dec. 1991, the measurement noise is assumed to be an 
autoregressive process and a whitening filter is applied to the residual signal before it is 

25 fed back to the coefficient updates. In the paper by Orgren, Dasgupta, Rohrs and Malik, 
it is assumed that the proper whitening filter is known a priori, while an adaptive 
whitening is considered in the paper by Ho. 



Y(0 = 



Max((£|c(l)| 2 -EKI 2 ).»wO ' 
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By way of contrast, the algorithms of the invention do not assume any particular 
model for the measurement noise (although it is assumed that a correlation matrix of 
reasonable size describes the noise properties adequately). Additionally, the invention 
provides frequency domain algorithms and minimizes a variant of the best linear unbiased 
5 estimate criterion which is known for its good numerical properties. Further, according 
to the invention, the noise correlation is estimated during natural pauses in speech. 

Those skilled in the art will appreciate that the present invention is not limited to 
the specific exemplary embodiments which have been described herein for purposes of 
illustration. The scope of the invention, therefore, is defined by the claims which are 
1 0 appended hereto, rather than the foregoing description, and all equivalents which are 
consistent with the meaning of the claims are intended to be embraced therein. 
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WE CLAIM : 

1 . An echo cancelation device configured to suppress an echo component of an 
observed signal, the echo component resulting from coupling of an echo source signal 
through an echo path, said echo cancelation device comprising: 

5 an adaptive filter configured to approximate said echo path and to thereby provide 

an estimate of said echo component, 

wherein an adaptive algorithm of said adaptive filter incorporates a measurement 
of a noise component of said observed signal. 

2. The echo cancelation device of claim 1, wherein said measurement of said noise 
10 component of said observed signal is an a priori measurement made in an environment in 

which said echo cancelation device is designed to operate. 

3. The echo cancelation device of claim 1, wherein said observed signal includes at 
least one intermittent speech component, and wherein measurements of said noise 
component of said observed signal are made in real time during pauses in said at least one 

15 speech component of said observed signal 

4. The echo cancelation device of claim 3, wherein said pauses in said at least one 
speech component of said observed signal are determined based upon a measurement of 
power in a block of samples of said echo source signal. 

5. The echo cancelation device of claim 1, wherein said echo estimate is subtracted 
20 from said observed signal to provide an echo-canceled error signal, and wherein said 

measurement of a noise component of said observed signal is based upon an estimate of a 
power spectrum of said error signal. 
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6. The echo cancelation device of claim 1, wherein an estimated impulse response of 
said adaptive filter is updated when a measurement of power in a block of samples of said 
echo source signal is above a threshold, and wherein said estimated impulse response of 
said adaptive filter is not updated otherwise. 

5 7. The echo cancelation device of claim 1, wherein said echo estimate is subtracted 
from said observed signal to provide an echo-canceled error signal, and wherein an 
estimated impulse response of said adaptive filter is computed based upon an estimate of 
a power spectrum of said error signal and an estimate of a power spectrum of said echo 
source signal. 

10 8. The echo cancelation device of claim 7, wherein said estimated impulse response 
of said adaptive filter is computed based upon a weighted sum of said error signal power 
spectrum estimate and said echo source power spectrum estimate. 

9. The echo cancelation device of claim 8, wherein said weighted sum is computed 

by adding said echo source power spectrum estimate to a product of said error signal 
1 5 power spectrum estimate and a noise matching parameter. 

10. The echo cancelation device of claim 9, wherein said noise matching parameter is 
adjusted dynamically based upon samples of said error signal and samples of said echo 
source signal. 

11. A method for canceling an echo component of an observed signal, the echo 

20 component resulting from coupling of an echo source signal through an echo path, said 
method comprising the steps of: 

sampling said echo source signal to provide a block of source signal samples; 

computing a discrete Fourier transform of said block of source signal samples to 
provide a frequency domain representation of said source signal; 
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multiplying said frequency domain representation of said source signal by a 
frequency domain estimate of an impulse response of said echo path to provide a 
frequency domain echo estimate; 

computing an inverse discrete Fourier transform of said frequency domain echo 
5 estimate to provide a time domain echo estimate; 

subtracting said time domain echo estimate from said observed signal to provide 
an echo canceled error signal; 

computing a discrete Fourier transform of a block of samples of said error signal 
to provide a frequency domain representation of said error signal; and 
10 adapting said frequency domain estimate of the impulse response of said echo 

path based upon said frequency domain representation of said error signal and based upon 
said frequency domain representation of said source signal, 

wherein said step of adapting said frequency domain estimate of said impulse 
response incorporates a measurement of a noise component of said observed signal. 

15 12. The method of claim 1 1 , wherein said step of adapting said frequency domain 
estimate of said impulse response comprises the steps of: 

updating said frequency domain estimate of said impulse response when a 
measurement of power in said block of source signal samples is above a threshold; and 

updating an estimate of a noise power spectrum of said error signal otherwise. 

20 13. The method of claim 1 2, wherein said step of updating said frequency domain 
estimate of said impulse response comprises the steps of: 

updating an estimate of a signal power spectrum of said source signal; 
computing a weighted sum of said noise power spectrum estimate and said signal 
power spectrum estimate; and 
25 computing an update of said frequency domain estimate based upon said weighted 

sum of said noise power spectrum estimate and said signal power spectrum estimate. 
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14. The method of claim 1 3, comprising the step of: 

adding said signal power spectrum estimate to a product of said noise power 
spectrum estimate and a noise matching parameter to provide said weighted sum. 

15. The method of claim 14, comprising the step of: 

dynamically adjusting said noise matching parameter based upon samples of said 
echo source signal and said echo canceled error signal. 
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